Probabilistic Model Predictive Safety Certification for Learning-Based Control
نویسندگان
چکیده
Reinforcement learning (RL) methods have demonstrated their efficiency in simulation. However, many of the applications for which RL offers great potential, such as autonomous driving, are also safety critical and require a certified closed-loop behavior order to meet specifications presence physical constraints. This article introduces concept called probabilistic model predictive certification (PMPSC), can be combined with any algorithm provides provable certificates terms state input chance constraints potentially large-scale systems. The certificate is realized through stochastic tube that safely connects current system terminal set states known safe. A novel formulation allows recursively feasible real-time computation tubes, despite possibly unbounded disturbances. design procedure PMPSC relying on Bayesian inference recent advances invariance presented. Using numerical car simulation, method its illustrated by enhancing an certificates.
منابع مشابه
Linear model predictive safety certification for learning-based control
While it has been repeatedly shown that learningbased controllers can provide superior performance, they often lack of safety guarantees. This paper aims at addressing this problem by introducing a model predictive safety certification (MPSC) scheme for polytopic linear systems with additive disturbances. The scheme verifies safety of a proposed learningbased input and modifies it as little as ...
متن کاملData-Efficient Reinforcement Learning with Probabilistic Model Predictive Control
Trial-and-error based reinforcement learning (RL) has seen rapid advancements in recent times, especially with the advent of deep neural networks. However, the majority of autonomous RL algorithms require a large number of interactions with the environment. A large number of interactions may be impractical in many real-world applications, such as robotics, and many practical systems have to obe...
متن کاملLearning-based model predictive control for Markov decision processes
We propose the use of Model Predictive Control (MPC) for controlling systems described by Markov decision processes. First, we consider a straightforward MPC algorithm for Markov decision processes. Then, we propose value functions, a means to deal with issues arising in conventional MPC, e.g., computational requirements and sub-optimality of actions. We use reinforcement learning to let an MPC...
متن کاملNonlinear Model Predictive Control with Probabilistic Models
Nonlinear Model Predictive Control (NMPC) is a powerful control framework, which strongly relies on a good model of the system dynamics. In the case, such a model is not available apriori, non-parametric regression using Bayesian regression or Gaussian Processes (GPs) have been shown promising in inferring the dynamics from collected data. An advantage of Bayesian methods and GPs over other reg...
متن کاملProbabilistic Model-Based Safety Analysis
Model-based safety analysis approaches aim at finding critical failure combinations by analysis of models of the whole system (i.e. software, hardware, failure modes and environment). The advantage of these methods compared to traditional approaches is that the analysis of the whole system gives more precise results. Only few model-based approaches have been applied to answer quantitative quest...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Automatic Control
سال: 2022
ISSN: ['0018-9286', '1558-2523', '2334-3303']
DOI: https://doi.org/10.1109/tac.2021.3049335